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Abstract: 

Technological  advances  over  the  past  decade  have  enabled  scientists  to  create  ever  larger  and  more 
complex  scientific  data  sets.  The  main  challenge  in  Scientific  Visualization  is  mapping 
high-dimensional  data  onto  a  2D  display  with  only  3  perceptual  dimensions  (RGB  colors).  In  order  to 
improve  perception  many  visualization  techniques  utilize  glyphs  which  encode  data  parameters  using 
geometric  properties  such  as  glyph  shape,  size,  and  orientation.  While  glyphs  have  been  shown  to  be 
effective  in  a  wide  variety  of  applications,  they  usually  only  show  information  at  a  single  point  and  it 
is  difficult  to  visualize  multiple  data  fields  at  once  in  order  to  discover  relationships  between  them. 
More  perceptual  dimensions  can  be  encoded  by  textures,  which  are  perceptually  characterized  by 
their  spatial  frequency,  contrast  and  orientation.  Recognition  of  patterns  is  accomplished  using 
primitive  textural  features  (textons),  such  as  length,  width  and  orientation,  with  line  segment 
orientation  being  particularly  important  for  visual  segmentation  of  surface  textures.  The  perceptual 
dimension  of  a  texture  is  therefore  in  the  ideal  case  the  sum  of  the  perceptual  dimensions  of  the 
inherent  (independent)  basic  attributes.  Additional  perceptual  dimensions  are  given  by  the  color 
distribution  and  spatial  frequency  of  a  texture. 

In  this  research  we  propose  and  evaluate  methods  for  creating  and  combining  textures  for  multi-field 
visualization.  We  have  identified  four  classes  of  post-processing  techniques  for  combining  textural 
representations  of  field  data:  blending,  overlay,  bump  mapping,  and  masking.  We  evaluated  the 
effectiveness  of  these  methods  by  using  them  for  visualizing  multiple  vector  fields  using  Line  Integral 
Convolution  (LIC)  textures.  Our  user  study  suggests  that  blending  is  the  most  effective  technique  to 
combine  multiple  vector  field  visualization  textures,  while  masking  performs  worst.  There  is  some 
evidence  that  visualizations  with  smooth  color  changes  are  perceived  as  visually  more  attractive,  and 
that  aesthetics  increases  the  perceived  effectiveness  of  a  visualization  technique.  Based  on  these 
results  we  have  created  a  new  generative  formal  grammar  called  texture  grammar  that  combines 
implementations  of  existing  visualization  techniques  and  image  compositing  techniques  to 
automatically  produce  visualizations,  depending  on  the  input  fields. 

Introduction: 

Aim  1:  Analysis  of  the  use  of  textures  for  scientific  visualization 

Results:  Characterization  of  visualization  techniques  by  visual  attributes  employed,  spatial  density, 
information  content,  and  generating  function 

Aim  2:  Find  perceptually  motivated  ways  to  combine  textures 

Results:  Alpha  blending  is  frequently  used  in  computer  graphics  to  simulate  transparencies  or 


Report  Documentation  Page 


Form  Approved 
OMB  No.  0704-0188 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 


1.  REPORT  DATE 

17  JUL  2013 


2.  REPORT  TYPE 

Final 


4.  TITLE  AND  SUBTITLE 

Novel  texture-based  visualization  methods  for  high-dimensional 
multi-field  data  sets 


6.  AUTHOR(S) 

Burkhard  Wuensche 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

University  of  Auckland, 22  Princes  Street, Auckland  , 1010, NZ, 1010 


3.  DATES  COVERED 

09-08-2011  to  08-01-2013 

5a.  CONTRACT  NUMBER 

FA23861114062 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

N/A 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

AOARD,  UNIT  45002,  APO,  AP,  96338-5002 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 

AOARD 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

AOARD-114062 


12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

Technological  advances  over  the  past  decade  have  enabled  scientists  to  create  ever  larger  and  more 
complex  scientific  data  sets.  The  main  challenge  in  Scientific  Visualization  is  mapping  high-dimensional 
data  onto  a  2D  display  with  only  3  perceptual  dimensions  (RGB  colors).  In  this  research  we  propose  and 
evaluate  methods  for  creating  and  combining  textures  for  multi-field  visualization.  We  have  identified  four 
classes  of  post-processing  techniques  for  combining  textural  representations  of  field  data:  blending, 
overlay,  bump  mapping,  and  masking.  We  evaluated  the  effectiveness  of  these  methods  by  using  them  for 
visualizing  multiple  vector  fields  using  Line  Integral  Convolution  (LIC)  textures.  Our  user  study  suggests 
that  blending  is  the  most  effective  technique  to  combine  multiple  vector  field  visualization  textures,  while 
masking  performs  worst.  There  is  some  evidence  that  visualizations  with  smooth  color  changes  are 
perceived  as  visually  more  attractive,  and  that  aesthetics  increases  the  perceived  effectiveness  of  a 
visualization  technique.  Based  on  these  results  we  have  created  a  new  generative  formal  grammar  called 
texture  grammar  that  combines  implementations  of  existing  visualization  techniques  and  image 
compositing  techniques  to  automatically  produce  visualizations,  depending  on  the  input  fields. 

15.  SUBJECT  TERMS 

Computational  Logic,  Software,  Computer  Science 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

18.  NUMBER 

19a.  NAME  OF 

ABSTRACT 

OF  PAGES 

RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Same  as 
Report  (SAR) 

9 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


combine  different  effects  such  as  shading  and  texture  mapping.  In  order  to  achieve  effective  blending 
we  exploit  chromatic  adaptation,  i.e.,  the  human  visual  system's  ability  to  adjust  to  changes  in 
illumination  and  preserve  the  appearance  of  object  colors.  We  hence  combine  two  textures  by 
encoding  them  with  different  hues  and  intensities  and  blending  them  with  an  alpha  value  between 
0.4  and  0.6. 

Figure-ground  perception  describes  the  observation  that  an  object  can  be  instantly  perceptually 
separated  from  its  background.  This  is  due  to  physically  different  attributes  of  a  figure  and  its 
background  but  is  also  influenced  by  size,  angle,  and  association  with  meaningful  shapes.  We  employ 
this  concept  to  overlay  two  textures  by  rendering  them  using  different  hues  (like  above)  and 
replacing  each  pixel  of  texture  II  with  the  corresponding  pixel  of  texture  12,  where  it  exceeds  a 
certain  threshold  t. 

Shape  perception  is  dominated  by  the  curvature  of  the  silhouette  contour  (figure-ground  boundary) 
and  3D  surface  shading.  We  exploit  this  property  by  combining  two  textures  by  representing  one  of 
them  using  shading  differences  which  simulate  surface  deformations.  This  concept  is  called  bump 
mapping  in  computer  graphics.  In  our  implementation  we  create  a  bump  map  by  rendering  the 
texture  of  the  second  field  using  a  much  lower  sampling  rate  and  applying  a  Roberts'  Cross  diagonal 
gradient  filter  to  calculate  edges.  This  gradient  image  is  multiplied  with  the  first  texture  image, 
resulting  in  the  second  texture  image  appearing  as  "bumps". 

The  concept  of  Gestalt  originates  from  the  fine  arts  and  expresses  the  notion  that  the  whole  contains 
more  information  than  the  parts.  Perception  of  Gestalt  is  influenced  by  proximity,  similarity, 
continuation,  closure,  symmetry,  and  the  law  of  Pragnanz,  which  states  that  the  eye  tends  to  see  the 
simplest  and  most  stable  figure.  We  exploit  Gestalt  perception  by  using  different  masks,  which 
subdivide  the  domain  of  two  fields,  and  show  for  each  section  only  one  field.  By  using  proximity  and 
continuation  the  human  visual  system  should  be  able  to  mentally  interpolate  a  field  over  a  region 
where  it  is  not  displayed. 

Aim  3:  Develop  a  grammar  for  automatically  constructing  effective  textures  for  visualizing  multi-field 
data 

Results:  A  grammar  is  created  by  having  terminal  symbols  defining  the  mapping  of  field  data  to 
visual  attributes,  and  reproduction  rules  which  incorporate  methods  for  combining  textures  and 
constraints  (maintenance  of  texture  characteristics,  perceptual  constraints). 


Experiment: 

In  order  to  evaluate  the  techniques  for  combining  textures  we  created  seven  unique  pairs  of 
different  vector  fields.  Each  vector  field  was  represented  by  a  600  x  600  pixel  texture,  and  contained 
1  to  3  critical  points  (nodes,  center,  focus  or  saddle).  Consequently,  each  visualization  of  two  vector 
fields  contained  2  to  6  critical  points.  The  precise  location  and  type  of  each  critical  point  was  stored 
in  a  database,  and  compared  with  the  user  input.  A  total  of  thirteen  different  visualization 
techniques,  using  the  four  concepts  introduced  above,  were  evaluated. 


Results  and  Discussion: 

We  evaluated  techniques  for  combining  vector  fields  with  a  user  study  and  showed  that  all  four 
concepts  aid  users  with  finding  critical  points  in  a  vector  field.  Blending  was  most  effective,  followed 
by  overlay  and  "crisp"  bump  maps.  Similar  results  were  obtained  for  efficiency.  There  were  some 
contradictions  between  perceived  and  actual  effectiveness.  The  results  suggest  that  aesthetics 
increases  the  perceived  effectiveness  of  a  visualization  technique,  and  that  visualizations  with 
smooth  color  changes  are  perceived  as  visually  more  attractive. 
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ABSTRACT 

The  visualisation  of  vector  fields  is  essential  for  many  ap¬ 
plications  in  science,  engineering  and  biomedicine.  A  large 
number  of  vector  icons  has  been  developed,  but  little  re¬ 
search  has  been  done  on  their  effectiveness,  especially  when 
visualising  multiple  vector  fields  simultaneously.  We  ap¬ 
ply  research  in  visualisation  and  cognitive  science  to  iden¬ 
tify  four  classes  of  post-processing  techniques  for  visualis¬ 
ing  two  2D  vector  fields  simultaneously:  blending ,  overlay, 
bump  mapping,  and  masking.  We  apply  these  four  post¬ 
processing  methods  to  Line  Integral  Convolution  (LIC)  tex¬ 
tures  and  thus  develop  several  novel  multi-field  visualisation 
techniques.  We  evaluate  their  effectiveness  with  a  user  study 
requiring  participants  to  locate  and  classify  singularities,  and 
to  rate  each  method  on  its  effectiveness  and  aesthetic  value. 
The  results  of  the  study  suggest  that  blending  is  the  most 
effective  technique  to  combine  multiple  vector  field  visualisa¬ 
tion  textures,  while  masking  performs  worst.  There  is  some 
evidence  that  visualisations  with  smooth  colour  changes  are 
perceived  as  visually  more  attractive,  and  that  aesthetics 
increases  the  perceived  effectiveness  of  a  visualisation  tech¬ 
nique. 

Categories  and  Subject  Descriptors 

1.3.3  [Picture/Image  Generation]:  Display  algorithms; 
1.3.7  [Three-Dimensional  Graphics  and  Realism]:  Color, 
shading,  shadowing,  and  texture;  1.6.8  [Simulation  and 
Modeling]:  Types  of  Simulation — Visual 

Keywords 

User  study,  vector  field  visualisation,  flow  visualisation,  multi- 
field  visualisation 

1.  INTRODUCTION 

Vector  field  visualisation  is  an  important  task  in  scientific 
visualisation.  A  large  variety  of  techniques  has  been  pro- 
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posed  ranging  from  vector  glyphs  [12]  and  textural  represen¬ 
tations  [26,  2],  to  the  visualisation  of  structural  information 
such  as  the  vector  field  topology  [19,  7]. 

One  central  issue  of  current  research  is  multi-field  visual¬ 
isation  [18].  Novel  image  acquisition  and  simulation  tech¬ 
niques  have  made  is  possible  to  record  a  large  number  of 
co-located  data  fields.  Visualising  them  simultaneously  fa¬ 
cilitates  the  investigation  of  correlations  and  relationships 
between  the  fields  [24].  An  example  is  the  visualisation 
of  multi-field  cardiac  imaging  data  (MRI,  PET,  CT,  DTI, 
tagged  MRI,  molecular  imaging)  in  order  to  analyse  the  re¬ 
lationship  between  cardiac  function,  structure,  anatomical 
changes,  metabolic  activity,  blood  perfusion,  and  cellular  re¬ 
modelling. 

In  this  paper  we  investigate  texture-based  visualisation 
techniques  for  displaying  two  2D  vector  fields  simultaneously. 
Section  2  reviews  previous  work  on  vector  field  visualisation 
and  multi-field  visualisation.  Section  3  explains  the  design  of 
our  multi-field  visualisation  techniques.  Section  4  presents 
an  evaluation  of  the  techniques  with  results  being  discussed 
in  section  5.  We  conclude  this  paper  and  give  an  outlook  on 
future  work  in  section  6. 

2.  LITERATURE  REVIEW 

Texture-based  representations  are  popular  for  vector  field 
visualisation  due  to  their  high  spatial  resolution  (vector  in¬ 
formation  is  displayed  for  many  points  of  the  domain  with 
comparatively  little  screen  space)  and  the  ease  with  which 
they  can  be  applied  to  different  2D  and  3D  geometries  [15]. 

One  of  the  earliest  classes  of  techniques  in  this  domain  is 
“Spot  noise”,  which  distributes  a  large  number  of  spots  over 
a  surface  and  transforms  them  according  to  the  underlying 
vector  field  [4].  A  contrasting  approach  is  to  place  stream¬ 
lines  close  together  until  the  visualisation  domain  is  covered 
and  then  separating  them  [10]. 

The  arguably  most  popular  texture-based  vector  field  vi¬ 
sualisation  technique  is  Line  Integral  Convolution  (LIC)  [2]. 
The  method  places  short  streamlines  over  each  pixel  of  an  in¬ 
put  texture  (usually  white  noise),  and  then  applies  a  convolu¬ 
tion  kernel  to  the  texels  covered  by  each  streamline.  LIC  has 
several  advantages  such  as  indicating  vector  field  direction 
in  every  point,  indicating  local  information  such  as  conver¬ 
gence,  producing  2D  or  3D  textures  which  can  be  visualised 
using  standard  rendering  techniques,  and  producing  images 
with  a  fine  spatial  resolution.  Moreover,  unlike  streamlines, 
LIC  does  not  depend  on  the  selection  of  good  seed  points. 

Multi-field  datasets  contain  several  fields  defined  over  the 


Figure  1:  Different  pairs  of  2D  vector  fields  visualised  simultaneously  using  the  blend  method  (left),  the 
overlay  method  (middle),  and  the  smooth  bump  map  method  (right). 


same  domain.  Blaas  et  al.  introduce  interaction  techniques 
for  selecting  and  comparing  components  of  interest  [1] .  Kniss 
et  al.  present  novel  transfer  functions  for  direct  volume 
rendering  high-dimensional  volume  data  sets  [13].  Weigle 
uses  rectangular  texture  elements  to  encode  multiple  vari¬ 
ables  [27].  Fuchs  and  Hauser  give  an  overview  of  state-of- 
the-art  techniques  for  visualizing  multi-field  data  [6]. 

Much  can  be  learned  from  observing  the  occurence  of  com¬ 
plex  textures  in  other  application  fields.  Interrante  suggests 
to  harness  the  intricate  variety  and  subtle  richness  of  de¬ 
tail  of  natural  texture  patterns  [9] .  Using  artistic  concepts 
and  associating  vector  information  with  brush  strokes  in  an 
oil-painting  makes  it  possible  to  combine  multiple  layers  of 
visual  elements  to  a  surface  texture  encoding  multiple  fields, 
while  still  allowing  perception  of  each  layer  [11]. 

Little  work  has  been  done  on  comparing  the  effectiveness 
of  vector  field  visualisation  techniques.  Laidlaw  et  al.  inves¬ 
tigated  the  effectiveness  of  six  visualisation  methods  for  two 
dimensional  vector  fields  by  means  of  a  user  study  [14].  Ur- 
ness  et  al.  present  strategies  for  visualising  multiple  2D  vec¬ 
tor  fields  by  overlaying  texture  and  glyph-based  techniques, 
but  do  not  evaluate  their  algorithms.  Our  research  identi¬ 
fies  key  concepts  for  combining  texture-based  visualisations, 
presents  several  new  techniques,  and  evaluates  them  with  a 
user  study. 

3.  DESIGN 

We  created  LIC  textures  of  vector  fields  using  Voreen  [16] 
and  used  concepts  from  graphics  and  cognitive  psychology 
to  combine  them.  Except  for  the  bump  map,  all  vector  fields 
were  rendered  using  an  implementation  of  the  fast  LIC  algo¬ 
rithm  [22]  in  Voreen  (sampling  each  pixel  and  using  a  large 
convolution  kernel  k  =  100).  Vector  field  magnitude  is  usu¬ 
ally  encoded  by  colour,  but  in  order  to  compare  the  differ¬ 
ent  techniques  we  only  display  vector  field  direction  and  use 
colour  to  perceptually  differentiate  multiple  fields. 

3.1  Blend 

Alpha  blending  is  frequently  used  in  computer  graphics  to 
simulate  transparencies  or  combine  different  effects  such  as 
shading  and  texture  mapping.  In  order  to  achieve  effective 
blending  we  exploit  chromatic  adaptation,  i.e.,  the  human 
visual  system’s  ability  to  adjust  to  changes  in  illumination 


and  preserve  the  appearance  of  object  colours  [5].  We  hence 
combine  two  textures  / 1  and  I2  by  encoding  them  with  dif¬ 
ferent  hues  (gray  and  yellow)  and,  as  in  the  original  LIC 
paper,  vary  the  intensity  for  the  white  noise  texture.  The 
textures  are  then  blended  using  an  alpha  value  a  £  [0.4,  0.6]. 

/result]*,  y)  =  ah(x,y)  +  (1  -  a)I2{x,y)  (1) 

The  left  hand  image  of  figure  1  shows  an  example. 


3.2  Overlay 

Figure-ground  perception  describes  the  observation  that 
an  object  can  be  instantly  perceptually  separated  from  its 
background  [21] .  This  is  due  to  physically  different  attributes 
of  a  figure  and  its  background  but  is  also  influenced  by  size, 
angle,  and  association  with  meaningful  shapes.  We  employ 
this  concept  to  overlay  two  LIC  textures  by  rendering  them 
using  different  hues  (like  above)  and  replacing  each  pixel  of 
texture  /1  with  the  corresponding  pixel  of  texture  I2,  where 
it  exceeds  a  threshold  t : 


/result  (*,  y') 


h{x,y)  if  I2{x,  y)  <  t 

I2(x,y)  if  I2{x,  y)  >  t 


The  image  in  the  middle  of  figure  1  shows  an  example. 


3.3  Bump  Map 

Shape  perception  is  dominated  by  the  curvature  of  the 
silhouette  contour  (figure-ground  boundary)  and  3D  surface 
shading  [8].  We  exploit  this  property  by  combining  two  tex¬ 
tures  by  representing  one  of  them  using  shading  differences 
which  simulate  surface  deformations.  This  concept  is  called 
bump  mapping  in  computer  graphics.  In  our  implementation 
we  create  a  bump  map  by  rendering  the  second  vector  field 
using  a  much  lower  sampling  rate  of  the  LIC  algorithm,  and 
applying  a  Roberts’  Cross  diagonal  gradient  filter  [20]  R  to 
calculate  edges.  This  gradient  image  is  multiplied  with  the 
first  image,  resulting  in  the  second  vector  field  appearing  as 
“bumps”.  In  our  subsequent  experiments  we  will  use  a  crisp 
version  explained  above  (equation  3),  and  a  smooth  version 
where  the  bumpmap  is  first  convolved  with  a  3  by  3  Gaussian 
kernel  G  (equation  4  and  figure  1  (right)). 

/result (x,y)  =  h(x,y){h*  R)(x,y)  (3) 

/result (z,i/)  =  h(x,y)({I2  *  R)  *  G)(x,y)  (4) 


Figure  2:  Four  visualisations  showing  two  vector 
fields  simultaneously  using  different  pattern  masks. 
From  the  top  left  image,  in  clockwise  order:  a  fine 
checkerboard  pattern,  a  gradual  shadow  weaving 
pattern,  a  solid  shadow  weaving  pattern,  and  a  fine 
diagonal  pattern. 


3.4  Pattern  Mask 

The  concept  of  Gestalt  originates  from  the  fine  arts  and 
expresses  the  notion  that  the  “whole  contains  more  infor¬ 
mation  than  the  parts”.  An  example  is  the  perception  of  a 
circular  arrangement  of  symbols  as  a  circle.  Perception  of 
Gestalt  is  influenced  by  proximity,  similarity,  continuation, 
closure,  symmetry,  and  the  law  of  Pragnanz,  which  states 
the  the  eyes  tend  to  see  the  simplest  and  most  stable  fig¬ 
ure  [21].  We  exploit  Gestalt  perception  by  using  different 
masks,  which  subdivide  the  domain  of  two  vector  fields,  and 
show  for  each  section  only  one  vector  field.  By  using  proxim¬ 
ity  and  continuation  the  human  visual  system  should  be  able 
to  mentally  interpolate  a  vector  field  over  a  region  where  it 
is  not  displayed.  Figure  2  shows  four  examples  of  masking 
patterns. 

Checkerboard  pattern:  These  patterns  have  been  suc¬ 
cessfully  used  in  medical  imaging  for  image  fusion  [23].  We 
investigate  a  coarse  and  a  fine  pattern  in  order  to  determine 
the  influence  of  size  on  the  human  visual  system’s  ability  to 
mentally  interpolate  textures. 

Diagonal,  horizontal  and  vertical  pattern:  We  ex¬ 
perimented  with  different  masking  pattern  orientations.  In 
our  user  study  we  use  a  coarse  and  a  fine  version  for  a  diago¬ 
nal  pattern,  and  a  coarse  version  of  a  horizontal  and  vertical 
pattern. 

Weaving  pattern:  Weaving  patterns  are  distinctive  and 
most  users  are  familiar  with  them.  We  use  a  gradual  shadow 
and  a  solid  shadow  checkerboard  weaving  pattern,  and  a 
longer  weaving  pattern  using  a  gradual  shadow.  The  use  of 
shadows  improves  contrast  between  regions  at  the  expense 
of  obscuring  continuation  of  texture  patterns. 

4.  EVALUATION 


Figure  3:  Web  interface  used  in  the  user  study.  The 
screen  shot  shows  a  critical  point  in  the  yellow  vector 
field  (indicated  as  transparent  red  circle)  located  by 
clicking  on  the  canvas.  The  click  has  triggered  a 
context  menu  enabling  the  user  to  select  the  type 
of  critical  point.  After  locating  and  classifying  all 
identified  critical  points  clicking  the  button  at  the 
bottom  displays  the  next  experiment. 


In  order  to  evaluate  the  above  presented  visualisation  tech¬ 
niques  we  created  seven  unique  pairs  of  different  vector  fields. 
Each  vector  field  was  represented  by  a  600  x  600  pixel  tex¬ 
ture,  and  contained  1  to  3  critical  points  (nodes,  center,  fo¬ 
cus  or  saddle).  Consequently  each  simultaneous  visualisa¬ 
tion  of  two  vector  fields  contained  2  to  6  critical  points.  The 
precise  location  and  type  of  each  critical  points  was  stored 
in  a  database,  and  compared  with  the  user  input.  A  total 
of  thirteen  different  visualisation  techniques,  using  the  four 
concepts  introduced  above,  were  evaluated. 

4.1  Methodology 

We  created  91  visualisations  by  using  seven  pairs  of  vector 
fields  and  thirteen  visualisation  techniques  employing  the 
four  concepts  introduced  in  section  3.  An  online  survey  was 
created  showing  for  each  of  the  13  visualisation  techniques 
one  image  displaying  one  randomly  selected  pair  of  vector 
fields  (each  vector  field  occurred  equally  often).  The  first 
page  of  the  survey  contained  a  quick  explanation  of  the  tasks 
(see  subsection  4.2). 

Removing  Bias:  The  participants  were  not  given  any 
form  of  training  other  than  an  introductory  text  and  example 
images.  In  order  to  counter  “learning  bias”,  the  order  in 
which  the  visualisations  were  tested  was  randomised  for  each 
participant.  Also,  to  avoid  bias  based  on  some  vector  field 
potentially  being  more  difficult  than  others,  an  image  was 
rendered  for  each  combination  of  visualisation  methods  and 
vector  field  pairs. 

Participant  Demographics:  The  user  study  had  55 
participants:  27  participants  with  experience  in  the  field  of 


data  visualisation  (“experts”)  and  28  “non-experts”.  Most  of 
the  “experts”  were  researchers  or  students  from  the  computer 
graphics  research  groups  at  the  University  of  Auckland  and 
the  University  of  Technology,  Delft.  The  survey  took  roughly 
15  minutes.  Participation  was  voluntary,  anonymous,  and  no 
compensation  was  given. 

4.2  Required  Participant  Tasks 

To  test  the  effectiveness  of  each  of  the  visualisation  meth¬ 
ods,  participants  were  required  to  perform  the  following  tasks 
for  each  visualisation: 

4.2.1  Locate  and  Classify  Critical  Points 

For  each  visualisation  participants  were  required  to  locate 
and  classify  all  critical  points  by  first  clicking  on  the  precise 
location  and  then  selecting  the  type  of  critical  point  (see  fig¬ 
ure  3).  The  visualisations  were  presented  on  a  600  by  600 
pixels  HTML5  canvas  element.  A  click  near  a  critical  point 
triggered  a  context  menu  showing  the  four  singularity  types. 

We  chose  as  admissible  target  area  a  circle  with  a  radius 
of  22  pixels.  In  a  preceding  pilot  study  this  provided  suffi¬ 
cient  distance  between  features  which  could  be  mistaken  as 
critical  points,  while  still  taking  into  account  errors  due  to 
rushed  motions  and  lack  of  image  information  (e.g.,  when 
using  masking  patterns).  The  process  was  repeated  until  a 
participant  clicked  the  “next  experiment”  button  to  indicate 
that  he/she  could  not  find  any  more  singularities.  The  loca¬ 
tion  of  a  click,  as  well  as  the  selected  singularity  type,  was 
recorded  using  JavaScript. 

4.2.2  User  Rating  of  Perceived  Effectiveness  and  Aes¬ 
thetic  Value 

Upon  completing  the  above  tasks  participants  were  shown 
all  13  previous  visualisations  in  identical  order  on  a  sin¬ 
gle  page.  Users  had  to  rate  each  visualisation  both  on  its 
perceived  effectiveness  (ease  to  locate  and  classify  critical 
points)  and  visually  attractiveness.  The  questions  were  rephrased 
as  statements  (e.g.,  “I  found  this  visualisation  effective”)  and 
ratings  were  performed  using  seven-point  Likert  scales  rang¬ 
ing  from  —3  (strongly  disagree)  to  3  (strongly  agree). 

The  user  rating  was  performed  to  detect  any  discrepancies 
between  participants’  perception  of  effectiveness  and  the  ac¬ 
tual  test  results.  The  aesthetic  value  of  a  visualisation  tech¬ 
niques  is  of  interest  since  it  can  effect  its  usage  in  commercial 
(business)  applications.  In  addition  studies  have  shown  that 
the  aesthetic  value  of  a  visualisation  is  related  to  users’  abil¬ 
ity  and  willingness  to  successfully  fulfill  visualisation  tasks  [3, 

17]- 

4.2.3  Measured  Data 

For  each  visualisation  the  selected  location  and  type  of 
critical  point  and  the  user  rating  was  stored.  In  addition 
the  time  period  for  each  visualisation  task  was  measured. 
From  this  data  we  derived  statistical  measures,  such  as  the 
percentage  of  found  critical  points,  the  percentage  of  correct 
classifications,  the  number  of  wrongly  located  or  classified 
critical  points. 

5.  RESULTS  AND  DISCUSSION 

5.1  Locating  and  Classifying  Critical  Points 

For  each  participant  we  computed  the  percentage  of  cor¬ 
rectly  located  and  classified  critical  points,  and  the  percent¬ 


age  of  incorrect  choices  (i.e.,  either  wrong  position  or  wrong 
classification).  Table  1  shows  in  the  first  two  columns  for 
each  of  these  measures  the  mean  value  and  standard  devia¬ 
tion. 

In  order  to  quantify  the  overall  effectiveness  and  accuracy 
of  each  method,  we  calculated  F\-scores  [25]  using  equa¬ 
tion  5.  Precision  is  the  number  of  correctly  classified  critical 
points  divided  by  the  total  number  of  clicks,  and  recall  is  the 
number  of  correctly  classified  critical  points  divided  by  the 
total  number  of  critical  points  that  should  have  been  found. 

^  „  precision  x  recall 

Fi  =  2  x  tL - — - - - -  5 

precision  +  recall 

Figure  4  shows  a  plot  of  the  mean  and  95%  confidence  in¬ 
terval  of  the  Fi-score  for  each  visualisation  technique.  The 
blend  method  has  the  highest  score,  closely  followed  by  the 
overlay  and  crisp  bump  map  methods.  The  masking  meth¬ 
ods  perform  far  worse  than  the  other  three  methods;  even 
the  best  performing  masking  method  (the  coarse  diagonal 
pattern)  has  a  significantly  lower  F\  than  any  of  the  non¬ 
masking  techniques  (the  smooth  bump  map  performs  only 
slightly  better). 

The  results  indicate  that  the  human  visual  system’s  abil¬ 
ity  of  Gestalt  continuation  are  not  sufficient  to  reliably  de¬ 
tect  features  in  a  vector  field  visualisation.  However,  with 
roughly  80%  correctness  results  are  sufficiently  good  to  jus¬ 
tify  further  investigation  in  selected  application  cases  where 
the  other  visualisation  techniques  are  not  practical  (e.g.,  if 
additional  scalar  fields  are  encoded  by  colour). 

With  regard  to  different  masking  patterns  the  coarse  diag¬ 
onal,  vertical,  and  horizontal  patterns  worked  best  and  also 
had  a  high  perceived  effectiveness.  The  weaving  pattern  with 
gradient  and  the  fine  checkerboard  pattern  rated  worst.  The 
results  indicate  that  visual  interpolation  of  missing  data  is 
most  effective  when  using  relatively  large  connected  regions 
without  boundaries. 

We  also  measured  the  precision  of  correctly  located  critical 
points.  Results  were  surprisingly  similar.  The  fine  diagonal 
pattern  mask  performed  best  with  an  average  location  error 
of  4.61  pixels,  followed  by  overlay  (4.65  pixels),  blend  (4.78 
pixels)  and  smooth  bumpmap  (4.87  pixels).  The  worst  lo¬ 
cation  error  was  observed  for  the  gradual  weaving  pattern 
(6.20  pixels). 

5.2  Response  Time 

We  evaluated  the  efficiency  of  the  presented  visualisation 
techniques  by  measuring  the  time  to  complete  the  visuali¬ 
sation  task  (fourth  column  of  table  1).  The  results  of  one 
participant  were  removed  since  the  measured  time  was  more 
than  2  hours,  which  suggests  that  the  user  interrupted  the 
study  at  least  once.  Figure  5  demonstrates  similar  results  as 
for  the  effectiveness.  The  response  time  for  the  blend,  overlay 
and  bump  map  methods  are  similar  and  faster  than  the  best 
performing  masking  method  (in  this  case  the  coarse  diago¬ 
nal  pattern).  The  worst  performing  method  is  the  weaving 
pattern  with  a  gradual  shadow.  The  results  suggest  that 
vector  held  perception  by  mental  interpolation  of  patterns 
is  considerable  less  efficient  than  perception  using  other  vi¬ 
sual  attributes  such  as  shading,  chromatic  adaptation,  and 
figure-ground  perception. 

5.3  Effectiveness  and  Aesthetics  Ratings 

The  last  two  columns  of  table  1  show  the  user  ratings  for 
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Table  1:  Results  of  the  user  study.  The  rows  represent  the  visualisation  methods  (c.  and  f.  stand  for 
coarse  and  fine  patterns).  The  columns  show  the  mean  and  standard  deviation  of  respectively  1)  fraction 
of  critical  points  that  were  correctly  classified,  2)  fraction  of  clicks  that  were  not  on  a  critical  point,  3)  the 
calculated  F-score,  4)  the  time  in  seconds  it  took  participants  to  complete  a  visualisation,  5)  the  rating  given 
for  effectiveness,  and  6)  the  rating  given  for  visual  attractiveness. 


the  effectiveness  and  visual  attractiveness  of  each  visualisa¬ 
tion  technique.  The  ratings  that  participants  gave  for  the 
effectiveness  are  largely  in  line  with  the  results  for  the  error 
metric  in  equation  5,  except  that  users  have  rated  the  overlay 
method  highest  for  effectiveness  (p,  =  1.78)  followed  by  blend 
(fi  =  1.56),  while  the  test  results  suggest  that  blend  is  the 
most  effective  method  followed  by  overlay.  The  smooth  and 
crisp  bump  map  follow  with  p  =  1.43.  All  of  the  masking 
methods  were  rated  significantly  lower  on  the  effectiveness 
scale,  the  horizontal  pattern  being  rated  the  most  effective 
with  p  =  0.11,  and  the  gradual  weaving  pattern  the  least 
with  p  —  —1.37.  Similar  results  are  obtained  for  the  aes¬ 
thetics  ratings. 

The  smooth  bump  maps  were  rated  as  more  aesthetic  than 
the  coarse  bump  maps  and  as  similarly  effective,  even  though 
their  actual  performance  was  inferior  to  the  coarse  bump 


Figure  4:  Mean  and  95%  confidence  interval  for  the 
F-score.  Both  bump  mapping  techniques  are  shown 
as  their  performance  differs  significantly.  For  the 
masking  technique,  only  the  result  for  the  best  per¬ 
forming  masking  pattern  (coarse  diagonal)  is  shown. 


maps.  In  general  methods  with  smooth  colour  changes  ob¬ 
tained  a  higher  rating  for  visual  attractiveness. 

A  contradiction  between  user  perception  and  performance 
was  also  observed  for  coarse  and  fine  masking  patterns. 
Whereas  the  fine  checkerboard  masking  pattern  performed 
better  in  terms  of  correctly  and  falsely  classified  singularities, 
users  perceived  the  coarse  masking  pattern  as  more  effective 
and  visually  more  attractive. 

The  results  suggest  that  aesthetics  increases  the  perceived 
effectiveness  of  a  visualisation  technique. 

6.  CONCLUSIONS  AND  FUTURE  WORK 

Based  on  properties  of  the  human  visual  system  we  have 
developed  four  classes  of  techniques  for  visualising  two  2D 
vector  fields  simultaneously:  blending  (alpha  blending  of  two 
LIC  textures),  overlay  (replacement  of  selected  pixels  in  one 
LIC  texture  with  those  form  another  LIC  texture),  bump 


blend  crisp  bumpmap  diagonal  mask  overlay  smooth  bumpmap 


Figure  5:  Mean  and  95%  confidence  interval  of  the 
time  taken  per  experiment  in  seconds.  For  the  mask¬ 
ing  technique,  only  the  results  for  the  best  perform¬ 
ing  pattern  (coarse  diagonal)  are  shown. 


mapping  (placement  of  an  LIC  texture  on  top  of  another 
LIC  texture  using  shading  differences  simulating  height  vari¬ 
ations)  and  pattern  masking  (division  of  an  image  into  re¬ 
gions,  each  of  which  displays  one  field  exclusively).  The  use 
of  bump  mapping  and  masking  seems  to  be  new  in  this  ap¬ 
plication  domain. 

We  evaluated  the  techniques  with  a  user  study  and  showed 
that  all  four  concepts  aid  users  with  finding  critical  points 
in  a  vector  field.  Blending  was  most  effective,  followed  by 
overlay  and  “crisp”  bump  maps.  Similar  results  were  ob¬ 
tained  for  efficiency.  There  were  some  contradictions  be¬ 
tween  perceived  and  actual  effectiveness.  The  results  sug¬ 
gest  that  aesthetics  increases  the  perceived  effectiveness  of  a 
visualisation  technique,  and  that  visualisations  with  smooth 
colour  changes  are  perceived  as  visually  more  attractive. 

In  future  work  we  want  to  test  the  presented  visualisa¬ 
tions  using  a  larger  variety  of  visualisation  tasks,  and  we 
want  to  investigate  in  more  detail  the  relationship  between 
aesthetics,  perceived  effectiveness  and  actual  effectiveness. 
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